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ABSTRACT 

This report reviews the concept and means of 
assessing progress toward meeting Goal 5 of the National Goals Panel 
which aims at universal adult literacy and knowledge and skills 
needed to compete in the global economy and exercise citizenship. The 
goal's specific objectives focus on the relationship between work and 
education and outcomes, increased enrollment (especially of 
minorities) in postsecondary education, and outcomes of postsecondary 
education. The report identifies significant issues to be addressed 
and coordinated nationally if a national strategy for assessing the 
results of postsecondary education is to develop. Six critical issues 
relating to achieving the national goal are identified: (1) defining 
assessment purposes, (2) defining skill levels and types, (3) 
providing inventory and coordination, (4) assigning responsibility 
for assessment, (5) developing systems, and (6) assessing progress 
toward the goal. Recommendations include: adoption of a uniform 
reporting format for reporting degree completion rates (a specific 
format is suggested); development of a sample-based national system 
of standards and assessment for postsecondary education; development 
of content and performance standards for general cognitive skills, 
higher order thinking skills, and occupational skills; and creation 
of a separate coordinating council for postsecondary standards and 
assessment. Included are two attachments, a table form for 
persistence and graduation rates and an inventory of assessment 
activities. (JB) 
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NATIONAL EDUCATION GOAL 5 



Goal 5: By the year 2000, every adult American will be literate and will possess the 
knowledge and skills necessary to compete in a global economy and 
exercise the rights and responsibilities of citizenship. 

Objectives: 

• Every major American business will be involved in strengthening the 
connection between education and work. 

• All workers will have the opportunity to acquire the knowledge and skills, from 
basic to highly technical, need to adapt to emerging new technologies, work 
methods, and markets through public and private educational, vocational, 
technical, workplace, or other programs. 

• The number of high-quality programs, including those at libraries, that are 
designed to serve more effectively the needs of the growing number of part- 
time and mid-career students will increase substantially. 

• The proportion of those qualified students (especially minorities) who enter 
college, who complete at least two years, and who complete their degree 
program will increase substantially. 

• The proportion of college graduates who demonstrate an advanced ability to 
think critically, communicate effectively, and solve problems will increase 
substantially. 
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REPORT OF THE TASK FORCE ON ASSESSING THE 
NATIONAL GOAL RELATING TO POSTSECONDARY EDUCATION 



I. Introduction 

In February 1992, the National Goals Panel convened a Task Force on Assessing the 
National Goal Relating to Postsecondary Education. This report reflects the Task Force's 
advice to the National Education Goals Panel on its charge, which was to investigate and 
report on: 

• the feasibility, desirability and schedule for developing standardized comparable 
state reports on the rate at which students entering higher education institutions 
complete their degree programs and by minority student status; and 

• the feasibility and desirability of a sample-based collegiate assessment which 
would provide regular national and state representative indicators of college 
graduates 1 ability to think critically, communicate effectively and solve 
problems. 

Fortunately, interest in the assessment of postsecondary education does not begin with 
the attention given it by the Goals Panel. There has been increasing imerest in postsecondary 
assessment over the past five years both at the state and institutional levels. Many state 
institutions, accrediting bodies and professional associations currently are engaged in some 
form of assessment activity. Further, the Goals Panel has considerable experience with the 
assessment of progress on the national goals at the elementary-secondary level. 

This report reviews both the concept and the means of assessing progress toward 
meeting Goal 5 as it applies to all of postsecondary education, not just the collegiate sector. 
It identifies a number of significant issues that must be addressed and coordinated nationally 
if a national strategy for assessing the results of postsecondary education is to develop. 

II. Objective: The proportion of those qualified students (especially minorities) 
who enter college, who complete at least two years, and who 
complete their degree programs will increase substantially. 

The Task Force believes that it is both feasible and desirable to develop a system of 
standardized comparable state reports on the rate at which students entering higher education 
institutions complete their degree programs and by minority status. This makes sense 
primarily because consumers of postsecondary education, including students, employers and 
funders, need to know how likely it is that students entering an institution will ultimately 
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meet their educational objectives including completion of a program. Retention and 
graduation rates, reflected accurately and comparably, provide useful indicators of institutional 
performance that can prompt more detailed analysis to identify the causes and implications of 
these simple descriptive statistics. 

Assuring accurate and comparable measures of retention and graduation rates, 
however, is difficult. A valid measure should include the full universe of institutions, 
including public, private, and not-for-profit institutions; should have mutually agreed upon 
persistence indicators (e.g., percent maintaining "normal" progress); several meaningful degree 
completion statistics (credit and programs completed as well as aggregate graduation rates); 
and contextual indicators that provide additional information to aid in interpreting and 
understanding student performance statistics, such as the type of program and the proportion 
of part-time, full-time and continuously enrolled students. 

Fortunately, the task of analyzing and reporting retention and graduation rates in 
postsecondary education is an area where substantial progress is being made. A number of 
states have begun developing composite statistics on persistence and graduation rates. While 
these disparate state efforts do not yet provide the level of interstate comparability necessary 
for a national system, they do serve as indicators of the state interest in such statistics. They 
also provide a starting point for developing uniformity in this process at the state level, where 
such information can be applied to policy and management decisions. 

In addition, the federal government, through two instruments — the Student Right- 
To-Know Act and the National Postsecondary Transcript Studies (NPTS) — has highlighted 
the importance of developing reliable information about the retention and graduation rates of 
students. The work of the National Center for Education Statistics (NCES) in developing 
common definitions for implementation of the Student Right-To-Know Act should be 
dovetailed with state efforts to develop composite comparative statistics on persistence and 
completion. 

The National Education Goals Panel and others interested in developing accurate and 
comparable national statistics on retention and completion rates should understand that the 
initial efforts by states and the federal government to provide these statistics will not fully 
measure up to our long-term quality standard objective. It will take some time to assure 
comparable definitions and to begin measuring the full range of information needed. For 
example, while initially data may be available in many states only for public institutions, the 
long-term goal must be to include all institutions in a reporting system. Ideally, this system 
must be electronic based in order to track students who transfer from one institution to 
another. 

Furthermore, statistics for part-time students can be misleading if there is no 
distinction between those who arc seeking a degree and those whose educational objective is 
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simply to take a course or two. Therefore, initial statistics, which do not distinguish between 
degree seeking students and others, could seriously underestimate the "success" of community 
colleges and urban universities that serve many non-degree seeking students. Yet the limits 
of these first generation data collection efforts cannot be used as an excuse for not moving 
forward. Recognizing the difficulties that will be encountered in reaching agreement on 
definitions and procedures, there is an emerging agreement that graduation and program 
completion rates are a legitimate public concern and should be reported. 

The Task Force therefore concludes : 

• A systematic and coordinated effort at the federal level should be 
developed to report degree completion rates. 

To further this agenda, the Task Force has developed a structure and set of definitions 
for state-based reporting which draws on the efforts of those states with tracking systems 
already in place (Attachment 1). To move toward a national system for measuring 
persistence and graduation rates, the Task Force recommends that : 

(1) The Goals Panel encourage the federal government to adopt a uniform 
reporting format for reporting degree completion rates (see Attachment 1 
for suggested format). 

(2) The Goals Panel encourage other states to adopt this reporting format. 

(3) The Goals Panel encourage all states to move as rapidly as possible to 
include all institutions, public and private, into the reporting system. 



III. Objective: The proportion of college graduates who demonstrate an advanced 
ability to think critically, communicate effectively, and solve 
problems will increase substantially. 

Policy makers at the state and federal level, as well as regular citizens, both deserve 
and need to know how well our nation's postsecondary education system works — do 
students learn what they need to know to be effective citizens and productive workers? 

No systematic way now exists to measure what our postsecondary students know 
based either on identified standards of performance or a comparative basis. Existing informal 
evaluations are often based on institutional reputations and public relations efforts. Without a 
systematic way to gauge postsecondary education's effectiveness, the result has been public 
confusion. Educators claim great success in serving an increasingly diverse student body, 
while others, including many state and federal policy makers and an increasing number of 
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vocal business leaders, decry the lack of preparedness of postsecondary graduates. 
Developing a national assessment system for postsecondary education will inform opinions 
about its success, just as the efforts to develop standards and assessment for elementary and 
secondary education will inform opinions about the success of that sector of education. A 
national assessment based on world-class standards, by clarifying the nation's expectations > 
will almost certainly help to raise standards and expectations of students, especially in our 
weakest institutions. 

This said, the Task Force does not underestimate the difficulty of developing a valid 
national assessment system because we still lack many of its most critical elements. We need 
validated ways of assessing critical thinking skills, communication and problem solving skills, 
as well as a national occupational skills certification system. Developing these systems will 
be costly and time consuming. Because postsecondary education's goals arc so diverse, it will 
be difficult to gain consensus on the specific objectives of a college degree. Because a 
national evaluation system may be perceived as fostering a national curriculum, many who 
value the diversity of the American postsecondary system of education will challenge a move 
in this direction. Nevertheless, our need to demonstrate to our many publics the effectiveness 
of postsecondary education and our need to maintain an internationally competitive 
postsecondary system requires us to move toward a more deliberate assessment of 
effectiveness. 

The Task Force concludes: 

• It is both feasible and desirable to develop a national sample-based 

postsecondary assessment system, which will provide regular national and 
state representative indicators of college graduates' ability to think 
critically, communicate effectively and solve problems and which includes 
assessments of occupational specific skills for students in occupationally 
specific programs. 

Having reached this conclusion, the Task Force identified six general issue areas 
which are critical to the success of this assessment effort. These issues are addressed below. 



Critical Issues 

1. Defining the Purpose of Assessment 

In general, assessment can serve two purposes: it can provide public awareness and 
accountability about performance, or it can provide institutions with information about how 
well they are performing compared to a national or other standard. While these objectives are 
not necessarily incompatible, neither arc the ways in which they may be accomplished 
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necessarily the same. It is important, therefore, to distinguish which purpose is most 
important to achieve Goal 5. 

The Task Force concludes : 

• The purpose of developing a national collegiate assessment system is, first 
and foremost, to monitor the nation's progress toward Goal 5. 

Clearly, a national effort to serve this purpc >e will focus most directly on the objective 
of assuring public awareness and accountability, rather than on the objective of stimulating 
reform via individually tailored institutional assessments. Further, a national system of 
assessment would recognize the ongoing autonomous pursuit of the unique missions of 
individual institutions. 

By concluding that monitoring the nation's progress toward a National Education Goal 
is the primary goal, we do not underestimate the importance of current postsecondary 
institutions' efforts to improve individual institutional performance. Individual institutional 
efforts remain critically important, but serve a different purpose than what the Goals Panel is 
seeking to accomplish. 

It is within this context that the Task Force recommends : 

(4) The Goals Panel encourage the development of a sample-based national 
system of standards and assessment for postsecondary education. 

Such a system would provide reliable evidence of how well the nation's postsecondary 
system is doing in achieving established standards, but would not produce reportable scores 
by institution. The system should be designed, however, to allow individual states and 
institutions to produce their own scores if they wish to gauge their own progress toward a 
national standard. 

2. Defining Types and Levels of Skills for Postsecondary Graduates 

Because no consensus exists today on what skills should be expected of college and 
vocational postsecondary graduates, one of the first tasks in developing a national assessment 
system must be to develop agreed upon standards of performance for postsecondary graduates, 
with a second task being to develop instruments and procedures to measure achievement of 
these standards. Specific strategies for developing national standards and assessment 
activities are identified in subsequent sections of this report. 
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National content and performance standards must be developed for postsecondary 
graduates as well as instruments that measure achievement of these standards. The Task 
Force recommends : 

(5) The Goals Panel suggest that content and performance standards be 
developed for general cognitive skills, higher order thinking skills, and 
occupational specific skills where appropriate. 

The instruments and procedures developed to measure attainment of these skills must 
recognize that skill competencies vary for different individuals, and thus measurement tools 
must be able to distinguish among the continuum of demonstrated skill levels above and 
below the standard. Operationally defined performance levels that bound the national 
standard should also be identified. 

3* Need for Inventory and Coordination 

While the assessment activities underway by states and the federal government are 
useful and will contribute to our ability to assess progress toward Goal 5, the Task Force 
recommends : 

(6) The Goals Panel insist that in order to maximize their usefulness, 
assessment efforts be better coordinated though a formal structure outlined 
in recommendation 8* 

Without coordination of efforts, separate assessment activities will become 
increasingly isolated and rigid and will contribute little to an overall, national assessment 
system. To this end, efforts of the National Governors' Association, the State Higher 
Education Executive Officers, the N ational Education Goals Panel, the U.S. Department of 
Education, the U.S. Department of Labor, and the Congress should all be coordinated into a 
single national collaborative effort. 

The Task Force made a preliminary effort to inventory current assessment activities 
(see Attachment 2). Such an inventory should be extended to include all state level efforts. 
Further, the current work of NCES to examine the usefulness of existing national assessment 
efforts should serve as a starting point for gaining an understanding of standards and 
assessment for postsecondary education. In addition, the efforts of the Department of 
Education and Department of Labor to develop a national skills certification process should 
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be more effectively coordinated and should be incorporated into the scope of the overall 
postsecondary standards and assessment activity. The Task Force recommends that: 

(7) The Goals Panel urge the U.S. Secretaries of Education and Labor approve 
funding for assessment and skills certification activities only if the activity 
is coordinated and recorded in the inventory of assessment activities 
(Attachment 2) to be maintained by the Goals Panel staff. 

4. Assigning Responsibility for Assessment: Federal, National or State? 

The initial response to the Task Force Inventory shows clearly that there is much 
assessment activity underway or planned at many levels — institutional, state, private and 
federal. However, it is questionable whether this can be sustained or that coherence can be 
achieved without a stronger national or federal role. "National" implies a national 
perspective, i.e., the National Education Goals Panel. "Federal" implies an agency of the 
federal government playing a key coordinating role. Obviously, a combination of federal and 
national is feasible. The Task Force concludes : 

(4) A national system has distinct advantages over a federal system because it 
requires a stronger partnership between the states and the federal 
government. 

A national system will not evolve on its o^vn. A concerted effort is required to create 
it. The Task Force beljeves that the Goals Panel should provide the leadership for the 
development of such a national effort. The Task R rce believes that the recommendations 
presented in the January 24, 1992 report of the National Council on Education Standards and 
Testing (NCEST) entitled Raising Standards for American Education , are equally salient for 
postsecondary education. That body recommended a council that would work toward national 
achievement standards and the certification of instruments that measure against those 
standards. 

To provide the necessary leadership and discipline to accomplish this task, the Task 
Force recommends: 

(8) The Goals Panel recommend the creation of a separate coordinating 
council for postsecondary standards and assessment that parallels that 
recommended by the National Council on Education Standards and 
Testing for elementary-secondary education and recommend financial 
support from the Congress to support this activity. 

A separate activity is needed to assure that a disciplined effort, focused solely on 
postsecondary education, is made. However, a steering committee should be established to 
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assure appropriate linkages between the NCEST recommended council and the one proposed 
here. 

5. Development of Assessment Systems: A Public or Private Responsibility? 

Initial response to our inventory of assessment activities shows that both private and 
public institutions are engaged in assessment efforts. However, most of the effort is in 
response to a public initiative either from the national or the state level. Therefore, the Task 
Forces concludes : 

• While the actual development of assessment efforts may be private, public, 
or a partnership of public and private entities, the development of national 
standards is principally a public responsibility and should be initiated and 
sustained as a public activity. 

Assuring coherence in coordination of assessment efforts and adherence to the highest 
professional standards of test development require a leading public role. Furthermore, the 
critical funds for development and maintenance are likely in the final analysis to come 
directly or indirectly from public sources. Therefore, voluntary or private initiatives are not 
likely to result in a national system of assessment or developing national standards for 
postsecondary education. 

6. Assessing Progress on Goal 5: A Comprehensive System or Fragmentation? 

The Task Force considered whether the overall objectives of the Goals Panel will best 
be served by the development of a comprehensive, integrated and complementary system of 
assessment as contrasted to discrete and selective assessments of single dimensions of 
postsecondary performance. 

For example, three types and levels of skills may be identified as necessary to meet 
Goal 5 for the adult American population. First are basic skills which are required to be 
effective in the work place and the learning placs. Second are occupational skills required to 
be effective in a particular job or profession. A third set of skills might be described as 
higher order skills of the type generally thought to be addressed in objective 5 of Goal 5. 
Currently, assessment development activity addresses these skills separately without thought 
for eventual integration into a system of assessment of the performance of our postsecondary 
system. The result is likely to be a fragmentation of assessments which do not provide a 
comprehensive view of how the system is performing. Further, it is likely that false 
dichotomies of skills will emerge which divide the efforts of our postsecondary systems both 
at the national and state level. The natural implication is to place higher value on some 
category of skills over another. Indeed, our system of postsecondary opportunities currently 
exhibits this fragmentation. In fact, our nation will be best served by the development of a 
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community of skills, mutually dependent and supportive of individuals' ability to pursue their 
learning potential to the fullest. 

The Task Force concludes : 

• The Goals Panel and the nation will be best served by the general 
integration of skill types into a comprehensive system of assessment 

The Task Force recommends : 

(9) The Goals Panel establish as an objective the development of a 

constellation of indicators of postsecondary performance which includes 
basic skill levels, occupational skill levels and higher order skills. 

Such a constellation will best reflect the diversity of institutions in the nation and will 
also better reflect the diverse needs of the American adult population. Such an approach 
would recognize skill levels before and after two years of higher education as well as four 
years of college. Within levels, it would allow distinction between adequacy, inadequacy, and 
distinction. It would provide a national profile of postsecondary skill attainment and allow 
individual states to develop profiles of adult skill levels which display the skill attainment 
levels of a population. 

IV. Summary 

In summary, the Task Force concludes its report with specific conclusions and 
recommendations in response to the charge given it by the Goals Panel. 

With regard to the feasibility, desirability and schedule for developing standardized 
comparable state reports on the rate at which students entering higher education institutions 
complete their degree programs and by minority status, the Task Force coiicllldes that: 

• A systematic and coordinated effort at the federal level should be 
developed to report degree completion rates. 

The Task Force recommends that: 

(1) The Goals Panel encourage the federal government to adopt a uniform 
reporting format for reporting degree completion rates (see Attachment 1 
for suggested format). 

(2) The Goals Panel encourage other states to adopt this reporting format. 
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(3) The Goals Panel encourage all states to move as rapidly as possible to 
include all institutions, public and private, into the reporting system. 

With regard to the feasibility and desirability of a sample-based collegiate assessment 
which would provide regular national and state indicators of college graduates 1 ability to think 
critically, communicate effectively and solve problems, the Task Force concludes that: 

• It is both feasible and desirable to develop a national sample-based 
postsecondary assessment system, which will provide regular national and 
state representative indicators of college graduates* ability to think 
critically, communicate effectively and solve problems and which includes 
assessments of occupational specific skills for students in occupational]} 
specific programs. 

• The purpose of developing a national collegiate assessment system is, first 
and foremost, to monitor the nation's progress toward Goal 5. 

The Task Force recommends that: 

(4) The Goals Panel encourage the development of a sample-based national 
system of standards and assessment for postsecondary education. 

(5) The Goals Panel suggest that content and performance standards be 
developed for general cognitive skills, higher order thinking skills, and 
occupational specific skills where appropriate. 

(6) The Goals Panel insist that in order to maximize their usefulness, 
assessment efforts be better coordinated though a formal structure outlined 
in recommendation 8. 

(7) The Goals Panel urge the U.S. Secretaries of Education and Labor approve 
funding for assessment and skills certification activities only if the activity 
is coordinated and recorded in the inventory of assessment activities 
(Attachment 2) to be maintained by the Goals Panel staff. 

The Task Force concludes that: 

• A national system has distinct advantages over a federal system because it 
requires a stronger partnership between the states and the federal 
government 
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The Task Force recommends that: 

(8) The Goals Panel recommend the creation of a separate coordinating 
council for postsecondary standards and assessment that parallels that 
recommended by the National Council on Education Standards and 
Testing for elementary-secondary education and recommend financial 
support from the Congress to support this activity. 

The Task Forces concludes that: 

• While the actual development of assessment efforts may be private, public, 
or a partnership of public and private entities, the development of national 
standards is principally a public responsibility and should be initiated and 
sustained as a public activity. 

• The Goals Panel and the nation will be best served by the general 
integration of skill types into a comprehensive system of assessment 

The Task Force recommends that: 

(9) The Goals Panel establish as an objective the development of a 
constellation of indicators of postsecondary performance which includes 
basic skill levels, occupational skill levels and higher order skills. 

In conclusion, the Task Force recognizes that the development of national standards 
and assessment measures for American postsecondary education is a long-term effort 
requiring much consensus building, assessment development and testing. It concludes, 
however, that the nation's future well-being depends upon the establishment of standards for 
learning which will raise educational achievement levels sufficient to insure that the United 
States' citizens are competitive with their counterparts throughout the world. The 
development of national standards of performance and assessment requires national leadership 
and federal support. 
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ATTACHMENT 1 

Persistence and Graduation Rates in Higher Education* 



The Task Force is indebted to Charles Lcnth, Director of SHEEO/NCES 
Communication Network, of the State of Higher Education Executive Officers 
(SHEEO) for staff assistance on this report format. Mr. Lenth's assistance does not 
represent endorsement by SHEEO of the Task Force's report. 
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Table for the National Education Goals Report 
Persistence and Graduation Rates in Higher Education 
Academic Year 19 , Based on Entering Class of Fall 1993 



Note: Columns 1 through 5 indicate the sectors and students indicated in 
the state "composite" figures. 

1 — Full-time students at public 4-year institutions 

2 — Part-time students at public 4-year institutions 

3 -- Full-time students at public 2-year institutions 

4 -- Part-time students at public 2-year institutions 

5 — Other 



State 


Sectors and 
Students 
Included 

1 2 3 4 5 


Entering 
Class 
Fall 
1993 


Enrolled 

Fall 

1994 

(%) 


Completed 
Associate 
Degree or 
Certificate 
by June 
iyy / 

(%) 


Completed 
Baccalaureate 
Degree by 
June 2000 

(%) 
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Arkansas 
















































































































































































































































• 








































— = — 




















1 Wisconsin 




















1 Wyoming 





















15 



Postsecondary Education 



ATTACHMENT 2 



Inventory of Assessment Activities Relating to 
Postsecondary Education* 



The Task Force on Assessing the National Goal Relating to Postsecondary Education 
developed and circulated a request for information on assessment activities underway 
(see attached survey form). Responses to the survey are incomplete. However, the 
inventory as currently developed indicates {he array of assessment activity planned or 
underway and the extent of funding for su<?h efforts. 
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